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ABSTRACT 

Tii the past few years, teacher training materials on 
behavior modification have emphasized precise behavioral measurement, 
and much classrooia research has focused on the measurement of 
academic performance. The most common and simplest recording 
procedure advocated is frequency count. Difficulties can arise, 
however, when attempts are made to compare frequencies from 
dayto-day. Basically, there are three means of interpreting 
frequency measures — which method is used depends on what the 
researcher is interested in. In some cases the data can be left in 
raw form and communicated to others as frequencies. This can take 
place only when assignment length, available work time, and 
assignment difficulty are held constant. Two other methods are 
percentages and rates. These are used when assignment length and/or 
time vary. Percentages provide information on accuracy, and rates can 
be used when there is an interest in assessing speed of performance. 
(Tables demonstrating problems encountered in interpreting frequency 
measures are included.) (PB) 
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During the past five years an increasing number of teacher train- 
ing materials (e.g., textbooks, programs, journal articles, and books 
of readings) have been devoted to classroom behavior modification. A 
major recurring theme throughout these works is an emphasis upon pre- 
cise behavioral measurement. This emphasis stems from the concern 
given to S"ch procedures by feMow operant researchers v/orking in 
the laboratory. Naturally, there are major d fferences between 
classrooms and laboratories, and as a result ihere have been attempts 
to modify existing laboratory recording procedures, and develop new 
recording methods more approprPate for classroom settings (e.g.. 
Bijou, Peterson, & Ault, 1973). 

For obvious reasons much classroom research has focused upon 
the measurement of academic performance. Many proponents of classroom 
management have devoted considerable space to the mechanics of record- 
ing academic behavior. The most common and simplest recording pre- 
cedure advocated is the frequency count. Frequency Is defined as 
the number of times a specific behavior occurs In a unit of time. 
In a classroom you might, for example, record the number of arithmetic 
problems completed correctly in a forty-minute period, or the number 
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of words spelled Incorrectly during a daily ten-minute spelling drill. 
The concept of frequency and the recording of frequency data are quite 
straightforward, and most teacher training materials present this In- 
formation clearly. Difficulties can arise, however^ in interpreting 
frequency data once it has been recorded. These difficulties can 
occur when attempts are made to compare frequencies from day-to-day. 
There are however, several ways to interpret frequency data so as to 
make Them comparable over time. 

Basically, there are three ways to interpret frequency measures. 
Such data can, under certain conditions, be left In raw form and com- 
municated to others as frequencies. Under other conditions, however, 
it may be necessary to translate frequencies into either rate or per- 
centage measures, in order to make the data meaningful. 

Unfortunately, in an effort to "sell" behavior modification, many 
training materials have oversimplified behavioral assessment procedures. 
Many of these training materials have tended to illustrate only the 
most elementary of interpretation approaches, that of leaving raw fre- 
quencies In their original form. Some materials (e.g., Ackerman, 1972; 
Kunzelman, 1970) have emphasized rate, often to the exclusion of 
frequency or percentage, while others have provided inadequate infor- 
mation about all "^hree methods of interpreting frequencies (e.g., 
Blackham & Sllb^rman, 1971; Buckley & Walker, 1970). 

Because of these watered-down or biased training devices, an 
educator proceeding through any one set of mater la Is might develop a 



very narrow picture of what to look for and how to assess student 
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academic performance. The purpose of this paper is tv/ofold: First, 
to identify the conditions under which it is appropriate to report 
frequency data as frequencies, rates or percentages; and second, to 
illustrate, via examples from published research and self-generated 
data, some of the confusion that can occur in analyzing frequency 
measures. 

A recent book by Cooper (1974) states that frequency data on 
academic performance can be interpreted and reported as simple fre- 
quencies only when three conditions are held constant over recording 
sessions: Assignment length, available work time, and assignment 
difficul+y. Careful examination of published research on classroom 
management indicates that formal investigations follow these require- 
ments for constancy. In fact, these three requirements are often 
followed so rigidly that student assignments frequently show repetitions 
of earlier items (e.g., Ferritor, Buckholdt, HambI in, & Smith, 1972; 
Kirby & Shields, 1972). On the other hand, most books and training 
manuals in classroom management generally do not emphasize these three 
conditions. Treatment of this topic ranges from virtually ignoring 
the conditions (e.g., Sulzer & Mayer, 1972) to providing short vignettes 
which may correctly Illustrate the constant conditions, but which do 
not emphasize either the need for constancy or the problems that might 
arise if one were to deviate from these requirements. Thus, if an 
educator was reading a book on classroom behavior modification which 
only discussed the reporting of simple frequencies, but did not present 
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complete information on the requirements for such reporting (e.g., 
Carter, 1972) he might well be faced with the data shown in Table L 



Insert Table I about here 



Examination of these data suggest equal performance over the three 
days. However, if available work tirne differed on each of these three 
days, interpretation takes on a new twist. As stated cbove, raw frequencies 
can no longer be compared over days because work time is not constant. 
The appropriate interpretation procedure becomes percentage or rate, al- 
though our hypothexical educator reading the frequency-oriented i raining 
text would not be av/are of this approach. 

Actually, of even greater concern than the above problem is the 
extent to which frequency interpretations are feasible In everyday 
classrooms. In our experience it is the exception rather than the 
rule that teachers assign academic tasks which are consistently equal 
in length, difficult/ and available work time. When one considers 
that behavior modification applications consist at the least, of 
baseline and reinforcement phases and occasional ly, reversal, rein- 
statement of reinforcement and post-check phases, one begins to appre- 
ciate the number of days that such procedures entail. This reduces 
even further the likelihood that constant conditions will be maintained, 
and, as a result we question rhe practicality of the raw frequency 
Interpretation method. 

When assignment length and/or time vary from day-to-day, it 
is necessary to translate simple frequencies into percentages or rates. 
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Which one you choose depends upon your interests • Percentages pro- 
vide information on accuracy. The mechanics of calculating per- 
centages present no difficulty. Hov/ever, two issues regarding 
percentages need to be examined in terms of their implications for 
the training of educators. First, as Cooper (1974) and Guilford 
(1965) argued, percentages should ideally be calculated only when 
the divlsor'is 100. However, if a lower limit is to be set it 
should be no less than 25. The reason for this requirement is that 
divisors less than 25 result in artificially inflated changes in 
percentages when the numerator varies by only a small amount. In.spite 
of this potential problem some training materials in classroom behav- 
ior modification have ignored this issue, perhaps assuming that edu- 
cators will "learn" these concepts elsewhere. This might be a 
mistaken assumption. Examination of certain published research in- 
dicates this very type of percentage misuse. Figures I and 2 show 
the results from two such articles (Hall, Axelrod, Tyler, Grief, Jones, 
& Robertson, 1972, p. 55; Schutte & Hopkins, 1970, p. 120). While per- 



Insert Figures I and 2 about here 

centage changes of up to 80^ were reported, the actual change in raw fre- 
quency was never more than four responses, usually less. Not only are 
such dramatic percentage changes misleading to the reader, but publication 
of these results in respected Journals helps to Insure the continuation 
of such practices. 

A second concern about percentages relates to the concept of 
accuracy. Most people refer to percentage measures of academic 



performance as accuracy. Unfortunately, there are two methods for cal- 
culating accuracy and usually little attention is given to how these 
two performance measures differ. In extreme cases. In fact, (Ay I Ion 
& Roberts, 1974) no mention is even made of which accuracy formula has 
been used. Accuracy can be based on the number of items correct di- 
vided by the number of items assigned, or, the number of items correct 
divided by the number of items attempted. Under certain conditions, 
when a student always attempts all items, these two measures are 
identical. However, at other times these formula can produce widely 
discrepant results. One formula can show an increase in accuracy while 
the other shows a decrease. With either formula accuracy can be shown 
to increase, over time, even though the number of Items correct remains 
perfectly stable, or even if items correct decrease. A recent paper by 
the first author (Klein, 1975) details these changes. In the present 
paper we wi I I just briefly portray one such example. Figure 3 shows 
arithmetic performance for a class of third-grade students (Ferritor 



Insert Figure 3 about here 

et al., 1972, p» \5)* The data portrayed by the solid lines connecting 
circles are the median number of correct problems. You can calculate 
one measure of accuracy., based on Items assigned by dividing the median 
number correct by assigned items. In this experiment, students v/ere 
always assigned 100 Items. Thus, In looking at the first two phases 
of the study It Is seen that number correct remained stable as did 
accuracy based on Items assigned* However, the data portrayed by the 
dotted lines connecting squares shows quite an Increase from phase One 
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to Phase Two. These data also happen to represent accuracy — accuracy 
based on items attempted. In looking at the third and fourth phases 
of the study one accuracy measure is seen to be increasing while the 
other decreases and vice-versa. These data not only demonstrate the 
need to better inform our colleagues of the various interpretation 
methods available, but they also suggest, perhaps more importantly, 
that we need to know exactly what we are interested In changing. 

Frequency data can be translated into rates when there is an 
Interest In assessing speed of performance. Rate Is simply performance 
divided by time. Rate has not been a popular measure with educators. 
Several texts on c!assrcx5m behavior modification do treat the topic 
thoroughly, (e.g., Ackerman, 1969; Kunzelman, 1970), but most books 
and journal articles In this area still favor frequency and percentage. 
With regard to academic performance one can present correct rate, error 
rate, and the sum of these two— total rate. The latter measure, total 
rate, really has very little meaning. Independent of either correct or 
error rate. In spite of this, total rate was the only measure reported 
in one of the first published classroom behavior modification investi- 
gations (Lovltt & Curtiss, 1969). In that research children were rein- 
forced for accurate academic performance, but In reporting their results 
the authors refer only to Increases in responses per minute, without 
indicating whether these increases were errors or correct Items. 

Similarly, Buckley and Walker (1970) In their book for teachers 
introduce the concept, of rate of academic performance, however, they 
only Illustrate the use of correct rate. To demonstrate some of the 
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confusion that couid develop if you looked only at this one variable, 
and to summarize some of our points thus far, Table 2 presents an ex- 
tension of the data presented in Table L 



Insert Table 2 about here 



This particular example shows a student whose correct rate is 
increasing. However, his error rate is also increasing, while both 
items correct, and the two measures of accuracy remain unchanged. If 
the educator was concerned only with correct rate he would see a 
gradual daily improvement. However, our recommendation based on data 
such as those in Table 2 Is that the educator should not put all of 
his eggs in one basket. Most importantly, the educator, rather than 
a book or training program, should decide exactly what performance 
measures are significant for the students with whom he is working. Such 
decisions can only be made foirly when sufficient information is provided. 

Although we realize that games can be played with data, for 
illustrative purposes, we believe more strongly that the omission of 
data Interpretation procedures In the training of educators can be quite 
damaging. We leave you with the data presented In Table 3 as one such 
possible example. 



Insert Table 3 about here 

Given a constant assignment length the data In Table 3 shows a de- 
creasing accuracy rate based on items assigned, a stable correct rate, a 
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stable accuracy rete based on items attempted, and an Increasing error 
rate. What Is really happening? It depends on what you are interested 
in. 
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TABLE 1 



Days 


Items Assigned 


Items Attempted 


Items Correct 


Errors 


1 


30 


30 


25 


5 


2 


30 


30 


25 


5 1 




30 


30 


25 


5 
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Figure L A record of the percentage o. time a teen-age boy used 
an orthodonic device, (From R. Vance Hall et al., 1972, p. 55.) 
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Figure 2. The daily mean percent of Instructions followed by 
all subjects for each session. (From R. C. Schutte and B. L. 
Hopkins, 1970, p. 120.) 
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Figure 3. Median number of arithmetic problems worked correctly 
and median percent worked correctly for a group of nine third graders 
working 100 computational problems. (From D, E, Ferritor, et aL, 
1972, p. 15. ) 



